Phase transitions in soft-committee machines
نویسندگان
چکیده
منابع مشابه
Phase Transitions in Soft Topographic
We have developed an algorithm (STVQ) for the optimization of neighborhood preserving maps by applying deterministic anneal-ing to an energy function for topographic vector quantization. The com-binatorial optimization problem is solved by introducing temperature dependent fuzzy assignments of data points to cluster centers and applying an EM-type algorithm at each temperature while annealing. ...
متن کاملStatistical Physics and Practical Training of Soft–Committee Machines
Equilibrium states of large layered neural networks with differentiable activation function and a single, linear output unit are investigated using the replica formalism. The quenched free energy of a student network with a very large number of hidden units learning a rule of perfectly matching complexity is calculated analytically. The system undergoes a first order phase transition from unspe...
متن کاملCommittee Machines
In this chapter, we describe some of the most important architectures and algorithms for committee machines. We discuss three reasons for using committee machines. The first reason is that a committee can achieve a test set performance unobtainable by a single committee member. As typical representative approaches, we describe simple averaging, bagging and boosting. Secondly with committee mach...
متن کاملPhase transitions in Restricted Boltzmann Machines with generic priors
We study generalized restricted Boltzmann machines with generic priors for units and weights, interpolating between Boolean and Gaussian variables. We present a complete analysis of the replica symmetric phase diagram of these systems, which can be regarded as generalized Hopfield models. We underline the role of the retrieval phase for both inference and learning processes and we show that ret...
متن کاملNUMERICAL SIMULATIONS OF THE PHASE TRANSITIONS IN CLUSTERS
We have studied the phase transitions in atomic clusters by molecular dynamics simulation, assuming Lennard-Jones interatomic pair potential. Calculations are performed by DAP parallel computer. The results are analyzed by simulating their orientational distribution plots (dot-plot), and neutron diffraction patterns. It is shown that all the main features of the bulk phase transitions are e...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Europhysics Letters (EPL)
سال: 1998
ISSN: 0295-5075,1286-4854
DOI: 10.1209/epl/i1998-00466-6